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(54) HANDWRITING INPUT RECOGNITION SYSTEM AND ITS METHOD 

(57)Abstract: ~~ 
PROBLEM TO BE SOLVED: To improve the input user 
interface of a portable terminal and to promote its size 
reduction and cost reduction. 

SOLUTION: The portable terminal 1 is equipped with an 
image input part 4 which receives user's handwriting 
input. When a character is handwritten and inputted to 
the image input part 4, the portable terminal 1 sends out 
image data including the character to a host device 6 
through a network 5. The host device 6 performs a 
character recognition processing for the received image 
data and sends the recognition result back to the 
portable terminal 1. The portable terminal 1 displays the 
character as the recognition result received from the host 
device 6 at a display part 2. 
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Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The handwriting input recognition system which has the 1st terminal unit which outputs 
handwriting input data as image data, and the 2nd terminal unit which recognizes the alphabetic 
character which performs character recognition processing to the image data which received 
from this 1st terminal unit, and is contained in the above-mentioned handwriting input data. 
[Claim 2] Are the handwriting input recognition approach of recognizing an alphabetic character 
etc. from the pattern by which the handwriting input was carried out, and it sets to the 1 st 
terminal unit. The handwriting input recognition approach of having the step which outputs a 
handwriting input configuration as image data, and the step which recognizes the alphabetic 
character which performs character recognition processing in the 2nd terminal unit to the image 
data which received from the 1st terminal unit of the above, and is contained in the above- 
mentioned handwriting input configuration. 

[Claim 3] In the 2nd terminal unit of the above, the input location on the handwriting input 
screen of the 1st terminal unit of the above, such as a recognized alphabetic character, is 
detected. In the step which sends out the information showing input locations, such as the 
recognized alphabetic characters, such as a recognized alphabetic character, to the 1st terminal 
unit of the above, or the 3rd terminal unit, and the 1st or 3rd terminal unit of the above The 
handwriting input recognition approach according to claim 2 which displays the alphabetic 
character recognized by the 2nd terminal unit of the above according to the information showing 
the input location received from the 2nd terminal unit of the above. 
[Claim 4] The step which notifies the input location on the handwriting input screen of a 
handwriting input configuration to the 2nd terminal unit of the above from the 1st terminal unit of 
the above, The step which matches with the 1st terminal unit of the above, or the 3rd terminal 
unit the information showing the input location received from the alphabetic character 
recognized in the 2nd terminal unit of the above, and the 1st terminal unit of the above from the 
2nd terminal unit of the above, and is sent out, The handwriting input recognition approach 
according to claim 2 which displays the alphabetic character recognized by the 2nd terminal unit 
of the above according to the information which expresses the input location received from the 
2nd terminal unit of the above in the 1st or 3rd terminal unit of the above. 
[Claim 5] The step which detects magnitude, such as a recognized alphabetic character, and 
sends out the information showing magnitude, such as the recognized alphabetic characters, 
such as a recognized alphabetic character, to the 1st terminal unit of the above, or the 3rd 
terminal unit in the 2nd terminal unit of the above, The handwriting input recognition approach 
according to claim 2 which displays the alphabetic character recognized by the 2nd terminal unit 
of the above according to the information which expresses magnitude, such as an alphabetic 
character received from the 2nd terminal- unit of the above, in the 1st or 3rd terminal unit of the 
above. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the system which recognizes a handwriting input 
configuration, and its approach. Moreover, it is involved in the system which processes the data 
inputted in a certain equipment in other equipments, and its approach. 
[0002] 

[Description of the Prior Art] Especially in an information society in recent years, various 
documents or drawings etc. have been electronized on business. Even if it is the contents of 
memorandum extent, it electronizes and to save depending on the case is demanded. 
[0003] The approach which starts the application program for document preparation etc. on a 
personal computer on the occasion of the electronization of a document, and the document 
preparation person inputs one character at a time using the keyboard is the most common. 
Moreover, the approach which starts the application program for drawing creation etc. on the 
occasion of electronization, such as a drawing, and a drawing implementer inputs using a 
keyboard or a mouse is common. 

[0004] By the way, a personal digital assistant with a handwriting input function is spreading 
recently. If it usually has a screen for making a user input a memorandum etc., for example, a 
user does the handwriting input of the memorandum sentence on that screen, this kind of 
personal digital assistant will analyze that input configuration, and will recognize the alphabetic 
character (a notation etc. is included) inputted as a handwriting pattern. And the recognized 
alphabetic character is displayed on the above-mentioned screen. Thus, as for the alphabetic 
character displayed after having been recognized, itself is already electronized. Moreover, it is 
convertible for the general-purpose data for document preparation applications in which the 
document electronized within the personal digital assistant depending on the model is installed 
on the personal computer through the predetermined interface. 

[0005] Thus, although electronization, such as a document, is generally performed using the 
keyboard or the mouse, the technique electronized by recognizing the alphabetic character by 
which the handwriting input was carried out using a computer is also being circulated. 
[0006] 

[Problem(s) to be Solved by the Invention] However, the actuation by the keyboard or the mouse 
cannot necessarily be referred to as easy for all users, but also requires a user poor at the 
actuation. Moreover, in order to key to the ability to do in slight time amount if it is handwriting 
in electronizing the contents of memorandum extent, after starting the application program for 
document preparation each time, actuation must be started and it is troublesome. 
[0007] On the other hand, by the approach of using handwriting input functions, such as a 
personal digital assistant, raising the recognition precision of an alphabetic character and 
measuring a miniaturization or low-cost-izing of the personal digital assistant are traded off. 
That is, although powerful character recognition software is needed in order to raise character 
recognition precision, generally such software has a large program scale, and its memory space 
demanded while a high performance processor is needed is also large. For this reason,Hzing is 
prevented from a miniaturization or low-cost-izing of a personal digital assistant, and further, 
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since that load is heavy, character recognition processing has a possibility that the performance 
of other processings of a personal digital assistant may fall. 

[0008] The technical problem of this invention is promoting a miniaturization or low-cost-izing of 

a personal digital assistant while measuring improvement in an input user interface. 

[0009] 

[Means for Solving the Problem] The handwriting input recognition system of this invention 
consists of the 1st terminal unit which outputs handwriting input data as image data, and the 2nd 
terminal unit which recognizes the alphabetic character which performs character recognition 
processing to the image data which received from the 1st terminal unit, and is contained in the 
above-mentioned handwriting input data. The 1st and 2nd terminal units are a personal digital 
assistant and host equipment, respectively, for example. 

[0010] The pattern by which the handwriting input was carried out in the 1st terminal unit is 
recognized by the 2nd terminal unit. This recognition result is transmitted to the 1st terminal 
unit or other terminal units, and is displayed there. That is, the image recognizing ability with 
which the 2nd terminal unit is equipped can be used for the 1st terminal unit by having the 
function which sends out handwriting input data to the 2nd terminal unit. 
[0011] In addition to the above-mentioned configuration, in the 2nd terminal unit, the input 
location on the handwriting input screen of the 1st terminal unit, such as a recognized alphabetic 
character, is detected, and you may make it display the alphabetic character by which 
recognition was carried out [ above-mentioned ] in the 1st terminal unit according to the 
information showing locations, such as an alphabetic character detected by the 2nd terminal unit 
of the above. In such a configuration, then the 1st terminal unit, it is changed and displayed on 
the location where the user did the handwriting input of the alphabetic character etc. by the 
condition that the alphabetic character etc. was electronized. 
[0012] 

[Embodiment of the Invention] Hereafter, it explains, referring to a drawing about the operation 
gestalt of this invention. Drawing 1 is the system configuration Fig. of this operation gestalt. The 
personal digital assistant 1 is equipped with communication facility, requests data processing 
from other equipments connected to the network 5, receives the result, and can display it on a 
display 2. Moreover, a personal digital assistant 1 is connected to a network 5 with the method 
which transmits and receives data on radio through a nearby base station, the method which 
transmit and receive data by infrared ray communication etc. between equipment (for example, 
optical link unit) with communication facility, or a cable. Transmission and reception of data with 
a network 5 are controlled by the transceiver section 3. Furthermore, a personal digital assistant 
1 is equipped with the image input section 4 for making a user do a handwriting input, and has 
the function to send to other equipments (for example, host equipment 6) by which the image 
data containing the handwriting pattern inputted from the image input section 4 was connected 
to the network 5, and to request pattern recognition processing (especially character 
recognition). 

[0013] A network 5 is a public telephone network, a PHS network, or LAN, and has held host 
equipment 6. Host equipment 6 is a server machine and performs data processing according to 
the request transmitted from a personal digital assistant 1. Moreover, host equipment 6 is 
equipped with an image pattern analysis and the recognition section 7. An image pattern analysis 
and the recognition section 7 perform pattern recognition processing and character recognition 
processing to the image data sent from a personal digital assistant 1, and detects the alphabetic 
character contained in the image data which received (a notation etc. is included). 
[0014] In the above-mentioned configuration, when the user of a personal digital assistant 1 
wants to electronize for example, a handwriting memorandum, a memorandum etc. is inputted 
using a handwriting pen using the image input section 4, and the image data containing the 
handwriting input configuration is sent to host equipment 6 through a network 5. Host equipment 
6 makes an image pattern analysis and the recognition section 7 analyze the image pattern, when 
image data is received from a personal digital assistant 1. An image pattern analysis and the 
recognition section 7 recognize the alphabetic character contained in the image data. 
[001 5] The recognition result by the image pattern analysis and the recognition section 7 may be 



http://www4.ipdljpo.go.jp/cgi-bin/tran_web_cgi_eije 



2004/06/1 1 



3/10 s<—$> 



saved to host equipment 6, may respond to ** automatically, and may be transmitted to a 
personal digital assistant 1. A personal digital assistant 1 will display the recognition result on a 
display 2, if a recognition result is received from host equipment 6. Moreover, the recognition 
result by the image pattern analysis and the recognition section 7 may be transmitted to the 
predetermined terminal unit specified beforehand. Furthermore, retrieval processing may be 
performed by making the recognition result into a keyword, and the recognition result may be 
translated into predetermined language. 

[0016] In addition, you may realize as a function in which host equipment 6 is obtained by 
[ predetermined ] carrying out program execution, and the computer which became independent 
in host equipment 6 may realize an image pattern analysis and the recognition section 7. 
[0017] Thus, what is necessary is just to input a memorandum in handwriting using the image 
input section 4 with which a personal digital assistant 1 is equipped and to send the image data 
containing the handwriting input configuration to host equipment 6 through a network 5 in the 
system of this operation gestalt, to electronize a handwriting memorandum etc. Character 
recognition processing is performed by host equipment 6. for this reason, as requirements for a 
configuration for electronizing a handwriting memorandum, the personal digital assistant 1 of a 
character recognition function is unnecessary, and can enjoy the recognition [ to have only the 
function and communication facility into which a user is made to input a handwriting pattern ] 
result of the advanced character recognition function [ coming out and measuring the formation 
of small lightweight, and low cost-ization ] by host equipment 6. 

[0018] Drawing 2 is the external view of a personal digital assistant 1. The personal digital 
assistant 1 is equipped with the LCD display 11, the slot 12 for IC cards, and the antenna 13 for 
radio. Moreover, in order to support other communication modes, it has the socket for Ir 
communication link, the socket for wire communications, etc. The LCD display 1 1 is a touch 
panel configuration, and the user of a personal digital assistant 1 can input a handwriting pattern 
and directions using the handwriting pen 14. 

[0019] Drawing 3 is the block diagram of a personal digital assistant 1. CPU21 performs the 
program stored in storage 22 (ROM and RAM). CPU21 and the store 22 of each other are 
connected through the bus 23. 

[0020] Storage 22 consists of semiconductor memory, a magnetic record medium, or an optical 
record medium, and stores a program, data, etc. Storage 22 may be formed in a personal digital 
assistant 1 fixed, and it may be equipped with it free [ attachment and detachment ]. 
[0021] It connects with the bus 23 and the record-medium driver 24 is equipment which reads 
the data stored in the portability record medium (semiconductor memory, a magnetic disk, an 
optical disk, and a magneto-optic disk are included) 25, or writes data in the portability record 
medium 25. An IC card is assumed as an example of the portability record medium 25. CPU21 
can also perform the program stored in the portability record medium 25. 
[0022] In addition, a program, data, etc. which are recorded on a store 22 may be made the 
configuration received and recorded from other devices connected through the communication 
line etc., and you may make it a program, data, etc. which are stored in the store with which 
CPU21 was formed in other devices side further used for them through a communication line 
etc. 

[0023] The unit corresponding to the LCD display 1 1 consists of a LCD control section 34 which 
controls the memory 32 which stores the information which should be displayed on a liquid 
crystal display (LCD) 31 and a liquid crystal display 31, the LCD driver 33 which outputs the 
information stored in memory 32 according to control of the LCD control section 34 to a liquid 
crystal display 31, memory 32, and the LCD driver 33, the touch panel section 35, and a touch 
panel control section 36 which notifies the input which the touch panel section 35 detected to 
CPU21. 

[0024] the tip of the handwriting pen 14 is located in the front face of the LCD display 1 1 — 
making (or it being made to press) — the touch panel section 35 detects the location in a liquid 
crystal display 31, and the touch panel control section 36 notifies the positional information to 
CPU21. When the personal digital assistant 1 has started the application for a handwriting input, 
the locus when moving the tip of the handwriting pen 14 in the front face of the LCD display 1 1 
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is notified to CPU21, and CPU21 displays the pattern expressed by the locus on a liquid crystal 
display 31. 

[0025] In case the communications control section 40 sends out data from a personal digital 
assistant 1, it generates a transmitting packet according to directions of CPU21, and passes it to 
the wireless transceivers 41 and 42 or the cable transceiver 43. Moreover, in case data are 
received, the data stored in the packet which received through the wireless transceivers 41 and 
42 or the cable transceiver 43 are outputted on a bus 24. It connects with the antenna 14 for 
radio shown in drawing 3 , and the wireless transceiver 41 delivers and receives wireless data 
between base transceiver stations 4. The wireless transceiver 42 is a transmitter-receiver for 
performing Ir communication link, and the cable transceiver 43 is a modem. The wireless 
transceiver 42 and the cable transceiver 43 are detached and attached as an option. In addition, 
the personal digital assistant 1 is further equipped with the clock 44. 
[0026] Drawing 4 is the example of a display of the handwriting input in a personal digital 
assistant 1. Starting of the application program for making a user do the handwriting input of a 
desired alphabetic character and a desired graphic form in a personal digital assistant 1 displays 
the handwriting field 51, the conversion carbon button 52, and a scroll button 53 on the LCD 
display 1 1, as shown in draw ing 4 . The handwriting field 51 is a field for carrying out the 
handwriting input of the alphabetic character and graphic form of a request to a user, and if an 
alphabetic character and a graphic form are drawn in the field using the handwriting pen 14, an 
alphabetic character or a graphic form will be displayed as the drawn locus. The conversion 
carbon button 52 is a carbon button for making a user input conversion directions, if the 
conversion carbon button 52 is pressed using the handwriting pen 14 in the condition that the 
alphabetic character is drawn in the handwriting field, will send out a personal digital assistant 1 
to host equipment 6 by making the image in the handwriting field 51 into image data, and will 
request character recognition. A scroll button 53 is a carbon button for scrolling the image in the 
handwriting field 51. 

[0027] Draw ing 5 is a flow chart explaining the processing after detecting a certain input in a 
personal digital assistant 1, and when a user does a handwriting input using the handwriting pen 
14, it shows the actuation at the time of receiving a packet from host equipment 6 here. In 
addition, the program which realizes each function shown in this flow chart is stored in storage 
22 with the gestalt of the program code which CPU21 can read. 

[0028] At step S1 t the detected input investigates whether it is a handwriting input (input with 
the handwriting pen 14) to the handwriting field 51. If it is an input to the handwriting field 51, it 
will progress to step S2, and if it is other inputs, it will progress to step S1 1. Thus, in the 
condition that the application program for carrying out the handwriting input of a desired 
alphabetic character and a desired graphic form is started by the user, if a user draws a desired 
alphabetic character or a desired graphic form on the handwriting field 51, processing after step 
S2 will be performed. 

[0029] According to the locus drawn on the handwriting field 51, the handwriting input 
configuration is expressed to the LCD display 1 1 as step S2. And in step S3, it investigates 
whether conversion directions were inputted from the user. The existence of conversion 
directions is judged by whether the conversion carbon button 52 shown in drawing 4 was 
pressed. If there are no conversion directions, it will wait for return and the next input to step 
S1. 

[0030] Detection of conversion directions creates the packet which stores the image containing 
the alphabetic character drawn on the handwriting field 51 as image data in step S4. Here, the 
handwriting field 51 in the time of the conversion carbon button 52 being pressed shall be made 
into a "current page", and the image data of the image of the current page shall be sent out to 
host equipment 6. That is, image data is sent out per page. In addition, about packet creation 
processing, it mentions later. At step S5, if it investigates whether the connection is established 
or not between host equipment 6 and established between, in step S6, the packet created by 
step S4 is sent out to a network 5 through the connection. On the other hand, if the connection 
is not established, it progresses to step S6, after establishing a connection in step S7. 
[0031] At step S1 1, it investigates whether the detected input is packet reception from host 
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equipment 6, and image display is performed according to the information extracted from the 
packet which received in step S12 when it was packet reception from host equipment 6, and if it 
is not packet reception from host equipment 6 f other processings will be performed in step S21. 
About processing of step S12 f it mentions later. 

[0032] Thus, a personal digital assistant 1 performs image display according to the information 
transmitted from host equipment 6 while sending out the image data of the image containing the 
alphabetic character by which the handwriting input was carried out to host equipment 6. 
[0033] Drawing 6 (a) It is drawing showing the structure of the packet sent out from a personal 
digital assistant 1. This packet is created in step S4 shown in drawing 5 . Each packet consists 
of a header unit and data division. A header unit stores the transmitting agency address, the 
arrival-of-the-mail place address, etc. It is decided by network configuration to which this 
operation gestalt is applied of what kind of address system the address will be stored as the 
transmitting agency address and the arrival-of-the-mail place address, for example, an IP 
address is stored in a TCP/IP communication link. 

[0034] Application identification information, Terminal ID, image data, etc. are stored in data 
division. Application identification information is information which identifies the application 
program which should start in the terminal (here host equipment 6) of an arrival-of-the-mail 
place. That is, it is a command for starting a predetermined program in the terminal of an arrival- 
ol^the-mail place. In this operation gestalt, the information which identifies image data analysis 
and a recognition program is set up. In addition, application identification information may be 
specified as a port number by TCP/IP communication link. 

[0035] Terminal ID is information which identifies the terminal of a transmitting agency, and is 
the identification number of a personal digital assistant 1. Image data is image data of the image 
in the handwriting field 51 at the time of the conversion carbon button 52 being pressed, and 
when stored in a packet, it is compressed. 

[0036] Draw ing 6 (b) It is the detail flowchart of the packet creation processing of step S4 
shown in drawing 5 . At step S31 f the image data transmitted to host equipment 6 is 
compressed, and it stores in data division. At step S32, the information which identifies image 
data analysis and a recognition program is set up as application identification information. At 
step S33, the information (information which identifies the end of a local) which identifies a 
personal digital assistant 1 as a terminal ID is set up. Furthermore, a header unit is created in 
step S34. The address of host equipment 6 is set to a header unit as the transmitting agency 
address at least as the address (address in the end of a local) and the arrival-of-the-mail place 
address of a personal digital assistant 1. 

[0037] The packet created as mentioned above is sent out to a network 5. A network 5 
transmits the packet to host equipment 6 according to the arrival-of-the-mail place address of a 
packet. The host equipment 6 which receives and processes this packet below is explained. 
[0038] Drawing 7 is the block diagram of host equipment 6. Storage 61 consists of 
semiconductor memory, a magnetic record medium, or an optical record medium, and stores a 
program, data, etc. Storage 61 may be formed in host equipment 6 fixed, and it may be equipped 
with it free [ attachment and detachment ]. 

[0039] The record-medium driver 62 is equipment which reads the data stored in the portability 
record medium (semiconductor memory, a magnetic disk, an optical disk, a magneto-optic disk, 
etc. are included) 63, or writes data in the portability record medium 63. The communications 
control section 64 is a unit which controls transfer of the data between networks. Transmission 
and reception of the packet between personal digital assistants 1 are also controlled here. 
[0040] From storage 61 or the portability record medium 63, CPU65 loads a program etc. to 
memory 66, and performs it. In addition, a program, data, etc. which are recorded on a store 61 
may write in what was stored in the portability record medium 63, and may make it the 
configuration received and recorded from other devices on a network through a communication 
line etc. Furthermore, you may make it a program, data, etc. which are stored in other stores 
formed on the network used for CPU65 through a communication line etc. 
[0041] Drawing 8 is a flow chart explaining processing of host equipment 6. Here, the packet 
(packet created by processing of the flow chart of drawing 5 ) to which host equipment 6 was 
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sent out from the personal digital assistant 1 is received, and actuation when host equipment 6 
receives a packet from a network 5 is explained focusing on the actuation which processes 
image data according to the information set as the data division. 

[0042] If a packet is received at step S41, the terminal which sent out the packet will be 
recognized by investigating the terminal ID set as the packet at step S42. At step S43, the 
application specified by the application identification information set as the packet which 
received is started. At step S44, it judges whether the started application includes image 
recognition processing. If it is the application which does not include image recognition 
processing, processing of the application will be performed in step S51. 

[0043] On the other hand, if it is application including image recognition processing, in step S45, 
pattern recognition processing and character recognition processing will be performed to the 
image data. In this example, pattern recognition processing and character recognition processing 
are performed in this step S45 to the image data of the image containing the alphabetic 
character written by hand to the handwriting field 51 of a personal digital assistant 1. In addition, 
about pattern recognition processing and character recognition processing of step S45, it 
mentions later. 

[0044] At step S46, the packet for returning a recognition result to a personal digital assistant 1 
is created. That is, the address of a personal digital assistant 1 is set up as the arrival-of-the- 
mail place address of this packet, and the above-mentioned recognition result is stored in those 
data division. And in step S47, the created packet is sent out to a network 5. 
[0045] The packet sent out to the network 5 in step S47 is transmitted to a personal digital 
assistant 1. A personal digital assistant 1 will display the result of the recognition processing by 
host equipment 6 on the LCD display 1 1, if this packet is received. This recognition result is 
saved in a personal digital assistant 1 by directions of a user. 

[0046] In addition, as mentioned above, a recognition result may be saved to host equipment 6. 
In this case, with image data, a recognition result is matched with the terminal ID of the terminal 
unit (namely, personal digital assistant 1) which sent out the recognition request, and is saved. 
Moreover, this recognition result may be transmitted to the predetermined terminal unit specified 
beforehand. Furthermore, retrieval processing may be performed by making into a keyword the 
character string contained in this recognition result, or that character string may be translated 
into predetermined language. In this case, a retrieval result or a translation result is sent to a 
personal digital assistant 1. 

[0047] Drawing 9 is the flow chart of the character recognition processing in host equipment 6, 
and explains processing of step S45 of drawing 8 to a detail. Below, the handwriting memorandum 
shown in drawing 4 in a personal digital assistant 1 is inputted, and the case where the image 
data of an image including the memorandum has been transmitted is taken up and explained to 
an example. 

[0048] At step S61, image data is taken out from the packet which received, and when the image 
data is compressed, it thaws. At step S62, character recognition processing is performed to the 
image data. This character recognition processing is a known technique. 
[0049] At step S63, the location of each alphabetic character recognized at step S62 is 
detected. For example, as shown in drawing 4 , the upper left hand corner of the handwriting field 
51 is made into a criteria location, and the relative coordinate of the center position of each 
alphabetic character is searched for by making the criteria location into a zero. At step S64, the 
"line" to which each alphabetic character belongs is recognized. In addition, in this example, the 
handwriting input in a personal digital assistant 1 shall have the regulation of inputting by lateral 
writing. Therefore, with reference to the positional information of each alphabetic character 
detected at step S63, the group of the alphabetic character in which "height" is similar in the 
handwriting field 51 is detected here. In the example shown in drawing 4 , since "3", the "moon", 
"1", "5", and a "day" are drawn on mutually similar height for example, five characters regard it 
as the thing belonging to these same lines. 

[0050] At step S65, the location in the line of each alphabetic character belonging to the line is 
detected for every line with reference to the positional information of each alphabetic character 
detected at step S63. As a location in a line, it detects as "the how many characters they are 
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from the left", for example. In each line, in consideration of spacing of alphabetic characters, 
when that spacing is beyond a predetermined value, a "tooth space" is detected at this time. It 
is considered that the tooth space is provided between a "shrine" and "O" in the 2nd line of the 
example of a display of drawin g 4 by this processing. 

[0051] At step S66, each graphic size is detected and the point corresponding to the magnitude 
is set up for every alphabetic character. For example, in the example shown in drawing 4 , "300" 
is drawn in the bigger alphabetic character than other alphabetic characters, and sets up the 
bigger point than other alphabetic characters to those three characters in this case. In addition, 
since it will be hard to read when the point may change for every character and it displays if 
many classes of point which should be set up are prepared, each graphic size is detected strictly 
and the point corresponding to the magnitude is set up, as the point set as each alphabetic 
character, it is made three kinds, for example. And in step S67, each alphabetic character 
recognized at step S62 is changed into character codes (for example, an ASCII code or JIS code 
etc.), respectively. 

[0052] Thus, in character recognition processing, while recognizing the alphabetic character (a 
tooth space is included) contained in the image data transmitted from the personal digital 
assistant 1, the location in the line to which each alphabetic character belongs, and the line of 
each alphabetic character, and the point of each alphabetic character are detected. Such 
information is stored in the packet created in step S46 of d rawin g 8 , and is sent out to a 
personal digital assistant 1. 

[0053] Drawing 10 is the block diagram of the packet for sending out a recognition result to a 
personal digital assistant 1 from host equipment 6. A packet consists of a header unit and data 
division. A header unit stores the transmitting agency address, the arrival-of-the-mail place 
address, etc. The transmitting agency address and the arrival-of-the-mail place address are the 
address of host equipment 6, and the address of a personal digital assistant 1 f respectively. 
[0054] The command for starting the display information for every alphabetic character and the 
application program which displays an alphabetic character etc. according to the above- 
mentioned display information in the arrival-of-the-mail tip end of this packet is stored in data 
division. As display information for every alphabetic character, the point corresponding to the 
character code of the alphabetic character, the number which identifies the line to which the 
alphabetic character belongs, the information showing the location in the line of the alphabetic 
character, and its graphic size is stored. 

[0055] If the above-mentioned packet is sent out to a network 5, a network 5 will transmit that 
packet to a personal digital assistant 1 according to the arrival-of-the-mail place address of this 
packet. In a personal digital assistant 1 f if this packet is received, in step S11 of drawing 5 , it will 
be judged as "Yes", and step S12 will be performed. 

[0056] Drawing 1 1 is the flow chart of the display process in a personal digital assistant 1, and is 
equivalent to step S12 of drawing 5 . That is, this flow chart is performed when a personal digital 
assistant 1 receives a recognition result from host equipment 6. 

[0057] The command taken out from the packet which received is executed at step S71. It 
continues and investigates whether it is that on which the application program started by the 
command displays a recognition result according to the display information stored in the packet 
which received in step S72. If it is the application on which a recognition result is displayed, 
processing after step S73 is performed, and when that is not right, processing by other 
applications will be performed in step S81. 

[0058] At step S73, the display information for one character is extracted from the packet which 
received. And in step S74, the alphabetic character is displayed on the LCD display 1 1 by 
drawing a display pattern in memory 32 according to the extracted display information. That is, 
based on the character code and the point which were extracted, the bit map data for displaying 
the alphabetic character on the LCD display 1 1 are generated first. Then, according to the 
location in the extracted line number and a line, the address which writes the bit map data in 
memory 32 is determined, and the bit map data generated according to it are written in memory 
32. And the LCD control section 34 displays the alphabetic character on a liquid crystal display 
31 according to the data currently written in memory 32. 
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[0059] At step S75, it investigates whether the alphabetic character which has not drawn among 
the alphabetic characters contained in the packet which received remains, and if it remains, it 
will return to step S73 so that the above-mentioned step S73 and step S74 may be performed 
to all alphabetic characters. 

[0060] The alphabetic character the handwriting input was carried out [ the alphabetic 
character ] in the personal digital assistant 1 by the above-mentioned processing is electronized. 
That is, the alphabetic character by which the handwriting input was carried out in the personal 
digital assistant 1 is recognized in host equipment 6, and the recognized alphabetic character is 
changed into the code which can treat document preparation application etc. At this time, the 
recognized alphabetic character is displayed in the magnitude which the user wrote in the 
location which the user of the LCD display 1 1 wrote in. 

[0061] Although the handwriting field 51 was a single input area and the user was the 
configuration which can write the alphabetic character of desired magnitude etc. in the location 
of the request in the field in the example (the 1st example) shown in above-mentioned drawing 
4 , drawing 6 - drawing 1 1 Two or more blocks are established as a handwriting field 51, and this 
invention can be applied also to the method which it writes in one character at a time in each 
block, as it is not limited to this method and shown in drawi ng 1 2 . Hereafter, two or more blocks 
are established as a handwriting field as the 2nd example, and the character recognition 
processing in the method which writes in the handwriting alphabetic character of one character 
at a time in 1 block is explained. 

[0062] In the 2nd example shown after drawing 12 , fundamentally, although processing of a 
personal digital assistant 1 is the same as what was shown in drawing 5 , it differs from the 1st 
example with packet creation processing of step S4, and above-mentioned display processing of 
step S12. 

[0063] Drawing 13 (a) In the 2nd example, it is drawing showing the structure of the packet sent 
out from a personal digital assistant 1. The header unit is the same as what was shown in 
drawing 6 . Data division consist of the common section and the individual block section. The 
application identification information and Terminal ID which are stored in the common section 
are the same as what was shown in drawing 6 . The individual block section stores the image 
data of the image within the block number and its block for every block. Here, a block number is 
information which identifies each block mutually, and can be used as information showing the 
location of each block in the LCD display 1 1. 

[0064] Drawing 13 (b) It is the detail flowchart of the packet creation processing in the 2nd 
example, and is equivalent to step S4 of drawing 5 . In step S91, it stores, and the image data of 
block number =i (initial value of i is set to 1) is compressed, and "i" is continuously set up as a 
block number corresponding to the image data at step S92. The image data for 1 block (one 
character) is stored in a packet with that block number by this. 

[0065] At step S93, it investigates whether the image data was stored in the packet about all 
blocks, and if still, a block number will be incremented in step S94, and it will return to step S91. 
[0066] By the above-mentioned processing, the image data of all blocks is stored in a packet 
with the block number, respectively. In addition, you may make it not store the block number and 
image data in a packet about the block with which the handwriting input is not carried out. If it 
does in this way, the amount of data delivered and received between a personal digital assistant 
1 and host equipment 6 is reducible. Steps S95-S97 are the same as steps S32-S34 of drawing 
6 . 

[0067] Drawing 14 is a flow chart explaining processing of host equipment 6 in which the packet 
shown in drawing 13 was received, and is equivalent to step S45 of drawing 8 . At step S101, 
when the image data of block number =i is taken out from the packet which received and the 
image data is compressed, it thaws. Then, in step S102, character recognition processing is 
performed to the image data of the block, and the alphabetic character further recognized in 
step S103 is changed into a character code. And in step S104, a character code is matched with 
block number i, and is held. 

[0068] At step S105, it investigates whether character recognition processing was performed to 
the image data of all blocks stored in the packet which received, and if there is a block which is 
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not performing character recognition processing, after incrementing a block number in step SI 06, 
it will return to step S101. 

[0069] By the above-mentioned processing, character recognition processing is performed to the 
image data of each block stored in the receive packet, and the character code of the alphabetic 
character by which the handwriting input was carried out in the personal digital assistant 1 is 
outputted. 

[0070] Drawing 15 is the block diagram of the packet created in case the character code 
obtained by processing of drawing 14 is sent out to a personal digital assistant 1. As shown in 
this drawing, in the 2nd example, the block number of the block with which the alphabetic 
character of each character code and its character code was written in is matched and stored. 
[0071] Drawing 1 6 is a flow chart which shows processing of a personal digital assistant 1 in 
which the recognition result by processing of dra win g 14 was received. This processing is 
processing of the personal digital assistant 1 at the time of receiving the packet shown in 
drawing 15 f and is equivalent to step S1 2 of drawing 5 . 

[0072] Steps S111 and S112 are the same as steps S71 and S72 of drawing 1 1 respectively. And 
it extracts the character code of block number =i, in step S1 14, the alphabetic character 
corresponding to the extracted character code is expressed to the block identified by block 
number -i as step S1 13. Then, in step S1 15, it investigates whether processing of the above- 
mentioned steps S113 and S114 is completed about all blocks, and if it has not ended, after 
incrementing a block number in step S1 16, it returns to step S113. 

[0073] Thus, in the 2nd example, if the handwriting input of the alphabetic character is carried 
out in a personal digital assistant 1 at a predetermined block, the block number of the block will 
be transmitted to host equipment 6 with the image data of the block. Host equipment 6 will be 
returned to a personal digital assistant 1 with the block number which carried out [ above- 
mentioned ] reception of the character code of the alphabetic character, if the alphabetic 
character contained in the image data is recognized. And a personal digital assistant 1 displays 
the alphabetic character generated according to the character code to the block identified by 
the block number. That is, also in the 2nd example shown in drawing 1 2 - drawing 16 , the 
alphabetic character by which the handwriting input was carried out in the personal digital 
assistant 1 is recognized by host equipment 6, and is electronized. At this time, the alphabetic 
character recognized by host equipment 6 is displayed on the location which the user of the 
LCD display 1 1 wrote in as it is. 

[0074] In addition, when character recognition in host equipment 6 is not able to finish extracting 
to one, a candidate is displayed on a personal digital assistant 1 at the display of delivery and a 
personal digital assistant 1 by using as a character code two or more recognition results which 
serve as a candidate, and a user may enable it to choose this. Moreover, although a personal 
digital assistant 1 is used individually in many cases, if host equipment 6 learns the peculiarity of 
a handwriting alphabetic character for every terminal ID and it is made to carry out character 
recognition, its precision of recognition will improve. This study fills in the alphabetic character 
which is easy to cause incorrect recognition among the handwriting alphabetic characters 
inputted until now in a personal digital assistant 1, has delivery and a user fill in the handwriting 
alphabetic character of each alphabetic character, and learns that correspondence relation as a 
table. 

[0075] Furthermore, the timing which transmits the alphabetic character by which the 
handwriting input was carried out in the personal digital assistant 1 to host equipment 6, and 
requests recognition processing may be any of an one-character unit, a word unit, a page unit, or 
a file unit. 

[0076] In the above-mentioned operation gestalt, the program which realizes each function 
shown with the processing program performed by host equipment 6, i.e., drawing 8 , and the flow 
chart shown in 9 and 1 4, the program which interprets and processes the information 
transmitted through a network are stored in storage 61 or the portability record medium 63 with 
the gestalt of the program code which CPU65 can read. Or what is stored in other equipments 
connected through a network is used. 
[0077] 
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[Effect of the Invention] According to this invention, the handwriting memorandum etc. can be 
electronized only by requesting recognition from host equipment for image data, such as a 
memorandum by which the handwriting input was carried out in the personal digital assistant. 
Thus, this invention offers the user interface which raised the operability at the time of 
electronizing an alphabetic character etc. 

[0078] Moreover, the recognition result of the advanced character recognition function by host 
equipment is enjoyable, measuring the formation of small lightweight, and low cost-ization, since 
it becomes unnecessary [ a character recognition function ] considering as the above-mentioned 
configuration as requirements for a configuration of the personal digital assistant for 
electronizing a handwriting memorandum etc. more. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawing 1] It is the system configuration Fig. of this operation gestalt. 
[Drawing 2] It is the external view of a personal digital assistant. 
[Drawing 3] It is the block diagram of a personal digital assistant. 

[Drawing 4] It is the example of a display of the handwriting input in a personal digital assistant. 
[Drawing 5] It is a flow chart explaining the processing after there is an input in a personal digital 
assistant. 

[ Drawing 6] (a) It is drawing showing the structure of the packet sent out from ** and a personal 

digital assistant, and is (b). It is the detail flowchart of packet creation processing. 

[Drawing 7] It is the block diagram of host equipment. 

[Drawing 8 ] It is a flow chart explaining processing of host equipment. 

[Drawing 9] It is the flow chart of the character recognition processing in host equipment. 
[Drawing 10] It is the block diagram of the packet for sending out a recognition result. 
[Drawing 1 1] It is the flow chart of the display process in a personal digital assistant. 
[Drawing 1 2] It is the example of a display of the handwriting input in the personal digital 
assistant of the 2nd example. 

[Drawing 1 3] (a) It is ** and drawing showing the structure of the packet sent out from the 
personal digital assistant of the 2nd example, and is (b). It is the detail flowchart of packet 
creation processing of the 2nd example. 

[Drawing 14] It is the flow chart of the character recognition processing in the host equipment of 
the 2nd example. 

[Drawing 1 5] It is the block diagram of the packet for sending out a recognition result in the 2nd 
example. 

[Drawing 1 6] It is the flow chart of the display process in the personal digital assistant of the 
2nd example. 

[Description of Notations] 

1 Personal Digital Assistant 

2 Display 

3 Transceiver Section 

4 Image Input Section 

5 Network 

6 Host Equipment 

7 Image Pattern Analysis and Recognition Section 
1 1 LCD Display 

21 CPU 

22 Storage 

24 Record-Medium Driver 

25 Portability Record Medium 
31 Liquid Crystal Display 

40 Communications Control Section 
51 Storage 
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52 Record-Medium Driver 

53 Portability Record Medium 

54 Communications Control Section 

55 CPU 

56 Memory 



[Translation done.] 
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